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Adult education’s mission is a critical one. It seeks to 
provide the large and diverse population of adults 
who lack basic skills, a high school credential, or 
English language skills with the competencies they 
need to be productive workers, family members, and 
citizens. Federally funded adult education serves 
learners in three types of programs: adult basic 
education, adult secondary education, and English as 
a second language (Exhibit 1). 


Nearly 43 million U.S. adults lack the basic English 
literacy skills required to succeed in the workforce 
and achieve economic self-sufficiency.' The 
Workforce Innovation and Opportunity Act (WIOA) is 
the key federal investment helping adults acquire 
these and other important skills, as well as to earn a 
high school equivalency credential. WIOA 
encourages adult education programs to use 
evidence-based strategies to improve services and 
participant success. This systematic research review 
suggests a need for more rigorous studies, as there is 
not yet much evidence to guide decision making 
around instructional and support strategies for adult 
learners. 


Succeeding in this mission requires that policymakers 
and local providers choose wisely from among a wide 
array of possible instructional and support strategies 
for adult learners. At the federal and state levels, 
policy and technical assistance efforts can emphasize 
particular strategies to encourage their adoption by 
local providers. At the local level, adult education 
providers need to select the specific strategies to use 
in their programs. In each case, focusing on strategies 
that have been shown to lead to positive outcomes 
for adult learners can increase the likelihood that 
adult education programs equip their participants 
with skills to help them succeed. 


This Snapshot was prepared under Contract No. 91990018C0057 by Kelley Borradaile, Alina Martinez, and Peter Schochet at Mathematica. Melanie Ali 


is the Project Officer for the Institute of Education Sciences. 


While policymakers and providers can learn from 
their everyday experiences, it is also important for 
them to have valid and reliable research-based 
information on what works. Well-designed, rigorous 
studies are the best way to be sure that learner 
outcomes are truly the result of the strategies of 
interest. Summarizing all the study results for each 
strategy is important because individual studies may 
report conflicting findings, providing an incomplete 
picture of all available evidence. 


Title II of the Workforce Innovation and Opportunity 
Act of 2014 recognizes these evidence needs and 
authorizes national activities to support them. It 
directs the federal government to conduct a national 
assessment of adult education, including activities to 
understand the extent to which adult education 
strategies positively affect learners. A systematic 
review of the research on the effectiveness of 
particular strategies in adult education is one way in 
which the U.S. Department of Education is fulfilling 
this mandate. 


This snapshot reports on that systematic review. This 
is the first review of a broad set of strategies in adult 
education to apply the standards and procedures of 
the U.S. Department of Education’s What Works 
Clearinghouse. It summarizes for policymakers and 
local providers the evidence base for many of the 
strategies authorized under Title II. It is designed to 
identify which strategies have evidence of 
effectiveness and where gaps appear in the evidence 
base. With this information, policymakers and 
practitioners can better understand the extent to 
which evidence supports particular strategies and 
which areas require additional studies. 


Data and Analysis 


The study team conducted a broad search to identify 
studies that examined the effectiveness of adult 
education strategies in improving adult learner 
outcomes. These studies included programs, 
activities, or services allowable under Title II. The 
search focused on studies that examined whether the 
strategies improved learner outcomes in one or more 
of four areas: academic skills, educational progress, 
employment, and earnings. The review focused on 


Exhibit 1. Federally supported adult 
education serves learners in three types of 
programs 


Adult basic 
education 
561,879 (40%) 


English as a 
second language 
680,413 (49%) 
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Adult 
secondary education 
147,396 (11%) 


Source: National Reporting System for Adult Education for 


program year 2017-18. 


Adult basic education serves learners with skills 
below the ninth-grade level. Adult secondary 
education serves learners with skills at least at the 
ninth-grade level. English as a second language 
serves learners with a first language that is not 
English. 


these areas because they are closely tied to the goals 
of adult education emphasized under Title II and 
directly relate to the outcomes for which federally 
supported adult education programs are held 
accountable. 


The team of certified reviewers reviewed the studies 
according to standards and procedures of the U.S. 
Department of Education’s What Works 
Clearinghouse. The What Works Clearinghouse was 
developed to identify high quality research that 
answers the question “What works in education?” 
Following the Clearinghouse’s standards and 
procedures enabled the study team to determine 
whether they could confidently attribute the effects 
reported by a study to the strategy tested rather than 
to other factors. 


Studies that met the Clearinghouse’s standards for 
well-conducted effectiveness studies were organized 
using seven adult education categories (Exhibit 2). 
These categories capture many, though not all, of the 
wide variety of strategies employed by adult 
education programs, including strategies closely 


aligned with Title II’s focus on postsecondary 
education transitions and workforce development. 
For example, the literacy instruction category 
includes strategies like ‘explicit instruction on 
reading’ and ‘extended reading practice.’ Using 
descriptions provided in the studies, the review team 
identified the strategies examined in each study and 
the appropriate category(ies) for each strategy (see 
Appendix A for details). Organizing the strategies into 
categories enabled the study team to see where 
research has been conducted and where gaps exist. 


Key Findings 


To date, there has been little rigorous research 
on whether particular strategies in adult 
education improve learner outcomes. 


e The review identified a total of 22 high- 
quality studies that examined whether a 
particular adult education strategy or 
combination of strategies improved learners’ 
outcomes. Although the study team found more 
than 2,000 publicly available adult education 
references—such as reports, papers, and journal 
articles—most of this literature did not examine 
the effectiveness of an adult education strategy. 
Only 54 studies examined the effectiveness of 
such strategies in improving the academic skills, 
educational progress, employment, or earnings 
of learners." Of these, only 22 met the What 
Works Clearinghouse’s standards, meaning that 
the study used a rigorous design to establish 
effectiveness and therefore the field can have 
confidence in its findings.” These 22 studies 
examined the effects of a wide range of adult 
education strategies (Exhibit 3). 


e Most of the studies examined the 
effectiveness of literacy instruction strategies 
for adult learners. Thirteen of the 22 studies 
that met standards examined literacy strategies 
alone, and an additional study examined literacy 
strategies in combination with other strategies.“ 
The research’s emphasis on literacy instruction is 
not surprising, as improving literacy skills has 


Exhibit 2. Categories of adult education 
strategies used in this review 


e Literacy instruction: Helping learners improve their 


literacy skills. 


Numeracy instruction: Helping learners improve 


their numeracy and math skills. 


English language acquisition instruction: Helping 


learners, whose native language is not English, 
improve their English language skills; this might also be 
referred to as instruction in English as a second 
language or English for speakers of other languages. 


Adult secondary education: Helping learners 


prepare for and obtain a high school equivalency 
diploma or credential. 


Tools to improve access to instruction: Helping 


learners access adult education instruction, such as 
distance learning, and technological solutions. 


Career development and transition instruction: 
Helping learners through opportunities to learn about, 
develop skills for, and prepare for employment in a 
specific industry or occupational sector. 


Individualized and targeted supports for learners: 
Helping learners navigate adult education, career 


paths, and educational paths. 


These categories were developed specifically for the 
purpose of this evidence review. Appendix A 
further explains these categories, how they were 
developed, how they are differentiated from each 
other, and examples of strategies that fall under the 
categories 


been a longstanding and explicit goal of adult 
education.” Literacy is a foundation of individual 
and community well-being; individuals with 
higher literacy skills have higher employment 
rates, higher earnings, and better health 
outcomes.“ Yet, one in five adults in the United 
States has low literacy skills.** Research that 
identifies effective strategies for improving adult 
literacy has the potential to help the field meet 
one of its fundamental goals. 


Several studies examined the effectiveness of 
career development and transition instruction 
and individualized and targeted learner 
support strategies for adult learners. Seven of 
the 22 studies that met standards examined 


Exhibit 3. Number of effectiveness studies within particular categories of adult education strategies, 


by outcome area 


Adult Education Outcome Area 


q fi 


Category of Adult Education Strategies Academic Educational & ‘s\= 


(Number of studies) 


Literacy instruction (14) 


Numeracy instruction (1) 


progress Employment Earnings 


English language acquisition instruction (1) 


Adult secondary education (3) 


Tools to improve access to adult education 
instruction (2) 


Career development and transition instruction (7) 


Individualized and targeted learner supports (7) 


effectiveness studies 


No rigorous 1 study 05) 2 to 4 studies 


M5 5 to 9 studies 8 More than 10 studies 


Source: The 22 studies that met What Works Clearinghouse version 4.0 standards with and without reservations. 


Note: Adult education categories are not mutually exclusive, so a single study may have examined strategies in multiple categories, 
and some studies examined effects in two or more outcome areas. Outcomes were combined into outcome areas that align with 
the primary indicators of performance for programs receiving Title II funding—academic skills, educational progress, 
employment, and earnings. See Appendix A for additional information on how outcomes were grouped into these four adult 


education outcome areas. 


approaches involving strategies in both of these 
categories; the approaches examined in two of 
these studies also involved strategies in adult 
secondary education and one also involved 
strategies in tools to improve access. While 
improving basic skills such as literacy is a long- 
standing and fundamental goal of adult 
education, WIOA also emphasizes the need to 
prepare adult learners for workforce success. 
Contextualized instruction that prepares learners 
for a specific industry or occupational sector and 
individualized supports such as career navigation 
services are examples of strategies designed to 
help learners develop and meet their career 


goals. Understanding whether these strategies 
help learners advance toward self-sufficiency is 
central to the goal of Title II, and helping 
policymakers and practitioners understand what 
strategies work. 


Only one study examined English language 
acquisition instruction strategies. Nearly one in 
ten U.S. adults is considered limited English 
proficient. While most of these individuals are in 
the labor force, they earn less than those with 
English proficiency.* Learners seeking to improve 
their English proficiency make up about half of 


all those in federally funded adult education 
programs. These numbers underscore the need 
for rigorous research on instructional strategies 
that work best for these learners. 


The remaining study examined a 
combination of strategies involving 
numeracy instruction, adult secondary 
education, and tools to improve access. Each of 
these areas is important in adult education. 
Adults with higher numeracy skills tend to be 
better prepared for the demands of the 
workforce.*! Yet nearly one in three U.S. adults 
lack basic numeracy skills.*“ This makes 
numeracy another important area of instruction 
for adult education, although one that has not 
experienced the significant and longstanding 
attention in policy discussions that literacy has.*# 
In addition, tools that support adult learners’ 
access to instruction, such as educational 
software or distance learning approaches, are 
becoming more commonplace.*" Adults juggle 
multiple responsibilities and often need the 
flexibility to receive instruction at the time or 
place of their choosing. Finally, adult secondary 
education is critical in helping adults attain a 
secondary school credential that is often needed 
to succeed in the workplace. Adults with high 
school or occupational credentials have higher 
earnings than those without.*” Without studies of 
what strategies in these areas work in improving 
learner outcomes, adult educators lack solid 
evidence to guide their instructional decisions. 


The rigorous research that has been conducted 
does not provide information on the 
effectiveness of strategies on the full set of 
outcome areas that federal policy emphasizes. 


Studies that included academic skills as 
outcomes did not look at longer term 
outcomes. Studies examining strategies in 
literacy, numeracy, and English acquisition 
instruction looked at outcomes related to 
academic skills but did not investigate whether 
the strategies improved longer term educational 


and labor market outcomes. This also occurred in 
one of the studies examining strategies in adult 
secondary education and another examining tools 
to improve access to instruction. Academic skills— 
such as comprehension and reading fluency for 
literacy instruction—are short-term outcomes, 
whereas educational progress, employment, and 
earnings are longer term outcomes. It is essential 
to know whether learners ultimately earn a 
credential and succeed in the labor market to 
understand whether the tested strategies will 
help learners reach Title II’s long-term goals for 
adult education. 


e Similarly, studies that investigated longer 
term outcomes did not measure academic 
skills. This occurred, in particular, for studies 
that examined strategies related to career 
development and transitions and individualized 
supports. For some strategies, like career 
navigation supports,*“’ not measuring academic 
skill outcomes is unsurprising, as improving 
academic skills is not a primary goal.*“" However, 
without examining effects on academic skills, 
studies miss the opportunity to understand 
whether improvements in academic skills may be 
leading to credential attainment or success in the 
labor market. 


The available evidence provides limited support 
for the use of particular adult education 
strategies over others, although bridge classes 
and integrated education and training programs 
offer some promise. 


e Research has yet to identify specific literacy 
instruction, numeracy instruction, and English 
language acquisition instruction strategies 
that lead to positive effects on learner 
outcomes. The various studies of strategies for 
literacy instruction found no positive effects of 
the tested strategies on any learner outcomes. 
Further, the sparse studies investigating 
strategies in numeracy instruction and English 
language acquisition instruction also found no 
positive effects of the tested strategies (see 


’ 


Appendix B for details of the individual studies and training (IET) in combination with other 


outcomes). strategies (Exhibit 5). Although there were 
consistently positive effects on educational 
Bridge classes are a common adult education progress across the studies, there were not 
strategy to help learners transition from basic consistently positive effects on employment and 
skills programming to postsecondary education earnings outcomes. A fifth study examined an 


and occupational training. 


approach that included basic skills instruction, 


e The limited research on bridge classes, a occupational skills training, and workforce 
career development and transitions strategy, preparation, all requirements of IET, but unlike 
provides some evidence of effectiveness on in IET the components were provided 
educational progress. Two studies examined sequentially rather than integrated, along with 
the effectiveness of bridge classes along with other strategies. This study also found positive 
other strategies like contextualized basic effects on educational progress but no effects on 
instruction on educational progress. One study employment or earnings.“ 


found positive effects and the other found no 


Affects onsprogness @xtibib4), IET is an educational model designed to provide 


adult learners with training for an in-demand 
e The larger set of research studies on occupation or occupational cluster while 


integrated education and training - another simultaneously strengthening their basic skills and 
career development and transitions strategy - building the soft skills needed for iieapidess 

: F , : success. These three components are integrated 
provides more evidence of effectiveness in ‘ i : ae 
: : ; into a single set of learning objectives. 
improving educational progress but 


inconsistent evidence for other outcomes. 
Four studies investigated integrated education 


Exhibit 4. The effects of strategies involving bridge classes on adult learners’ outcomes 


Adult Education Outcome Area 


@ Fl » 


Academic Educational 


es 


Strategies tested by each study skills progress Employment Earnings 


Bridge classes; contextualized basic skills +) 
instruction; preparation for high school equivalency 
test; and career navigation supports* 


Bridge classes; contextualized basic skills © 
instruction; and wraparound services to address 

basic needs and logistical barriers™ 
The following icons indicate presence or lack of a significant effect: 


© No effect +) Positive effect (—) Negative effect & Mixed effect 


Source: The two studies that examined strategies involving bridge classes that prepared learners to transition to either occupational 
training or college courses and that met What Works Clearinghouse version 4.0 standards with and without reservations. 


Note: Outcomes were combined into outcome areas that align with the primary indicators of performance for programs receiving Title 
II funding—academic skills, educational progress, employment, and earnings. Mixed effects indicate the findings within an 
outcome area include both statistically significant positive and statistically significant negative effects. See Appendix A for 
additional information on how findings were classified as no effect, positive effect, negative effect, and mixed effects. 


e Often, studies tested combinations of various 
strategies, making it difficult or impossible to 


isolate the effect of a particular strategy. 
Adult education often combines strategies to 
meet the needs of adult learners, and so that is 
what the studies evaluate. In particular, the 
studies that examined career development and 


transitions strategies examined these when they 


were used in tandem with targeted learner 
supports strategies and sometimes strategies in 
adult secondary education and tools to improve 
access. From these studies that examined a 
bundling of strategies, it is unclear whether a 
single strategy or the bundling of 


strategies is responsible for any effects observed. 
For example, when interpreting the bridge 
studies, it is unclear whether bridge classes alone 
can be effective in improving educational 
progress or if bridge classes are effective only 
when combined with other strategies. Some 
strategies are bundled together frequently, like 
IET and wraparound services, so isolating the 
impacts of each strategy might be less important. 
Other strategies, like career navigation, may be 
offered on their own so there is value in 
understanding their unique effects. 


Exhibit 5. The effects of strategies involving integrated education and training on adult learners’ 


outcomes 


Adult Education Outcome Area 


Ge 


Academic Educational KS 


Strategies tested by each study 


IET through co-planning and alternate teaching; 
preparation for high school equivalency test; and 
wraparound services to address basic needs and 
logistical barriers *# 


progress Employment Earnings 


IET through co-teaching; career navigation supports; 
and wraparound services to address basic needs and 
logistical barriers*“# 


IET through co-teaching; co-enrollment with credit 
courses at colleges; career navigation supports; and 
wraparound services to address basic needs and 
logistical barriers” 


IET through co-teaching; co-enrollment with credit 
courses at colleges; career navigation supports; and 
wraparound services to address basic needs and 


logistical barriers*”’ 


The following icons indicate presence or lack of a significant effect: 


+) Positive effect (—) Negative effect e Mixed effect 


e) No effect 


oO 
6 
oO 
© 


o 8 © O 


© 


Source: The four studies that examined strategies involving integrated education and training and that met What Works Clearinghouse 


version 4.0 standards with and without reservations. 


Note: Outcomes were organized into outcome areas that align with the primary indicators of performance for programs receiving Title 
II funding—academic skills, educational progress, employment, and earnings. Mixed effects indicates the findings within an 
outcome area include both statistically significant positive and statistically significant negative effects. See Appendix A for 
additional information on how findings were classified as no effect, positive effect, negative effect, and mixed effects. 


Looking Ahead 


Despite the critical mission of adult education, there 
is limited evidence so far to guide policymakers and 
practitioners toward particular strategies likely to be 
effective in improving adult learners’ outcomes. 
Fortunately, opportunities exist to increase the 
evidence base on effective adult education strategies. 


e Title II emphasizes performance 
measurement, data which in turn may be 
used in research. Under WIOA, Title II requires 
that adult education programs collect data on 
skill gains, educational progress, employment, 
and earnings for program participants. The 
availability of these data opens new opportunities 
for examining whether particular adult education 
strategies might improve these learner outcomes. 


e Title II brings to the forefront longer term 
outcomes like educational attainment and 
success in the labor market—outcomes for 
which reliable data sources exist. Whereas the 
Workforce Investment Act, which preceded 
WIOA, emphasized outcomes such as 
postsecondary enrollment, WIOA emphasizes 
longer term educational attainment and labor 
market outcomes. This emphasis provides 
opportunities to conduct research on adult 
education strategies with an increased focus on 
improving adult learner transitions to 
postsecondary education or to better jobs and 
higher earnings. Sources such as the National 


Student Clearinghouse and the National Directory 
of New Hires may be used to accurately and 
reliably measure postsecondary credentials and 
employment. 


e There are opportunities and interest in 
funding research to improve the skills of 
adult learners. At the federal level, WIOA 
mandates an independent national evaluation of 
adult education programs, including examining 
the effectiveness of adult education strategies. 
Additionally, the Institute of Education Sciences 
provides grant funding opportunities to examine 
the effectiveness of adult education strategies in 
improving learner outcomes. 


e Research can be guided by the design 
standards of the What Works Clearinghouse. 
Following these study design standards would 
result in research with greater rigor. The findings 
from this research could be interpreted with 
confidence that any effect observed is due to the 
strategy tested. This research could therefore 
help identify effective strategies in adult 
education. 


With these opportunities comes the need for the 
adult education field to prioritize where to put 
investments in research and to design and conduct 
rigorous evaluations. As the research builds, 
policymakers and local providers will then be better 
able to target their resources on effective strategies to 
help adult learners achieve successful outcomes. 
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